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Abstract 

The objective of this piece of research is to interpret and investigate systematically an observed brain 
functional phenomenon which associated with proceeding of e-learning processes. More specifically, this 
work addresses an interesting and challenging educational issue concerned with dynamical evaluation of e- 
learning performance considering convergence (response) time. That’s based on an interdisciplinary 
recent approach named as Artificial Neural Networks (ANNs) modeling. Which incorporate Nero- 
physiology, educational psychology, cognitive, and learning sciences. Herein, adopted application of neural 
modeling results in realistic dynamical measurements of e-learners’ response time performance parameter. 
Initially, it considers time evolution of learners’ experienced acquired intelligence level during proceeding 
of learning / training process. In the context of neurobiological details, the state of synaptic connectivity 
pattern (weight vector) inside e-learner’s brain-at any time instant-supposed to be presented as timely 
varying dependent parameter. The varying modified synaptic state expected to lead to obtain stored 
experience spontaneously as learner’s output (answer). Obviously, obtained responsive learner’s output is a 
resulting action to any arbitrary external input stimulus (question). So, as the initial brain state of synaptic 
connectivity pattern (vector) considered as pre-intelligence level measured parameter. Actually, obtained e- 
learner’s answer is compatibly consistent with modified state of internal / stored experienced level of 
intelligence. In other words, dynamical changes of brain synaptic pattern (weight vector) modify adaptively 
convergence time of learning processes, so as to reach desired answer. Additionally, introduced research 
work is motivated by some obtained results for performance evaluation of some neural system models 
concerned with convergence time of learning process. Moreover, this paper considers interpretation of 
interrelations among some other interesting results obtained by a set of previously published educational 
models. The interpretational evaluation and analysis for introduced models results in some applicable 
studies at educational field as well as medically promising treatment of learning disabilities. Finally, an 
interesting comparative analogy between performances of ANNs modeling versus Ant Colony System 
(ACS) optimization presented at the end of this paper. 
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1. Introduction 

Due to currently rapid development in the learning field sciences, and technology-mediated learning, many 
educational experts adopted facing of recent educational systems' challenges (Hassan, 2005). Referring to 
(Grossberg, 1988) natural intelligence and artificial neural networks (ANN S ) models have been adopted to 
investigate systematically mysteries of the most complex biological neural system (human brain). Accordingly, 
evolutionary interdisciplinary trends have been adopted by educationalists, neurobiologists, psychologists, as well 
as computer engineering researchers in order to carry out realistic investigations for critical challenging 
educational issues (Hassan, 1998); (Hassan, 2004); (Hassan, 2005b). Furthermore, during last decade of last 
century, educationalists have adopted recent Computer generation namely as natural intelligence as well as 
developed trends in information technology in to reach systematic analysis and evaluation of learning processes' 
performance phenomenon. In more details, it is worthy to refer to White House Ostp Report(U.S.A.) in 1989; 
therein, it has been announced that decade (1990-2000) named as Decade of the brain (OSTP, 1989). Consequently, 
human brain functions' modeling by using applications of artificial neural networks' paradigms have been 
considered as an adopted evolutional interdisciplinary approach by educationalists incorporating Nero-physiology, 
psychology, and cognitive learning sciences. 

Generally, evaluation of learning performance is a challenging, interesting, and critical educational issues 
(Hassan, 2007); (Hassan, 2008). 

Hassan (2016b); Hassan (2016c); Hassan (2014); Hassan (2012). Specifically, considering academic performance 
of e-learning systems some interesting papers have been published as introduced at Hassan (2011a); Hassan 
(2011b); Hassan (2011b); Hassan (2013); Hassan (2014); Hassan (2016c). Educationalists have been in need for 
knowing how neurons synapses inside the brain are interconnected together, and communication among brain 
regions (Swaminathan, 2007). By this information they can fully understand how the brain s structure gives rise to 
perception, learning, and behavior, and consequently, they can investigate well the learning process phenomenon. 
This paper presents an investigational approach getting insight with e-learning evaluation issue adopting (ANN^) 
modeling. The suggested model motivated by synaptic connectivity dynamics of neuronal pattern(s) inside brain 
which equivalently called as synaptic plasticity while coincidence detection learning (Hebbian rule) is considered 
(Hebb, 1949). The presented interdisciplinary work aims to simulate appropriately performance evaluation issue in 
e-learning systems with special attention to face to face tutoring .That purpose fulfilled by adopting learner s 
convergence (response) time ,(as an appropriate metric parameter) to evaluate his interaction with e-learning 
course material(s) . In fact this metric learning parameter is one of learning parameters recommended for using in 
educational field by most of educationalists. In practice, it is measured by a learner's elapsed time till 
accomplishment of a pre-assigned achievement level (learning output) (Hebb, 1949); (Hassan, 2005a); (Tsien, 
2001). Thus, superior quality of evaluated e-leaning system performance could be reached via global decrement of 
learners' response time. Accordingly, that response time needed -to accomplish pre-assigned learners’ achievement- 
is a relevant indicator towards quality of any-under evaluation- learning system. Obviously, after successful timely 
updating of dynamical state vector (inside e-learner's brain) pre-assigned achievement is accomplished (Tsien, 
2000); (Fukaya, 1988). Consequently, assigned learning output level is accomplished if and only if connectivity 
pattern dynamics (inside learner s brain) reaches a stable convergence state,(following Hebbian learning rule). In 
other words, connectivity vector pattern associated to biological neuronal network performs coincidence detection 
to input stimulating vector, i.e. inside a learner's brain, dynamical changes of synaptic connectivity pattern (weight 
vector) modifies adaptively convergence time, so as to deliver (output desired answer). Hence, synaptic weight 
vector has become capable to spontaneous responding (delivering correctly coincident answer) to its environmental 
input vector (question) (Hebb, 1949); (Kandel, 1979); (Haykin, 1999); (Tsien, 2000); (Douglas, 2005). Interestingly, 
some innovative research work considering the analogy between learning at smart swarm intelligence (Ant Colony 
Systems) and that at behavioral neural have been published at Hassan (2008); Hassan (2008); Hassan (2008); Ursula 
(2008); Hassan (2015a); Hassan (2015b). 

The rest of this paper is organized as follows. The next second section composed of two subsections (2.1 & 2.2). 
At subsection 2.1, revising for the two basic brain functions learning and memory is introduced in brief. The 
mathematical formulation for a single neuronal modeling function presented at subsection 2.2. At the third section, 
the analogy between brain functions and ANN models is illustrated. A review for performance evaluation 
techniques is given at the fourth section. Selectivity criteria in ANN models are briefly reviewed at the fifth section. 
At sixth section, modeling for three learning phases (Learning under supervision face to face), unsupervised 
learning (self-study), and learning by interaction with fellow learners) is presented . Experimental measurement of 
response time and simulation results are shown at the seventh section. This section considers the effect of gain 
factor of ANN on the time response in addition to comparative analogy between the gain factor effect- during 
learning process evaluation- in neural systems. Versus the impact of intercommunication cooperative learning 
cooperative learning parameter -while to solving Traveling Sale Man Problem - in Ant Colony System (ACS). At 
the last eighth section, some interesting conclusions and suggestions for future work are presented. Finally, by the 
end of this paper three Appendices are given .Appendices A&B illustrate the mathematical modeling equations 
given in the above considering learning (with and without supervision paradigms) respectively. They are written 
according to MATLAB software -version 6- programming language. The third Appendix C is presenting a 
simplified macro level flowchart describing algorithmic steps for different number of neurons using Artificial 
Neural Networks modeling. 

2. Revising of Learners’ Brain Function 

2.1 Basic Brain Functions 

Referring to OSTP REPORT (U.S.A.) in 1989 that announced Decade of the brain ( 1990 - 2000 ) (OSTP, 1989). The 
neural network theorists as well as neurobiologists have focused their attention on making a contribution to investigate 
systematically biological neural systems (such as the brain), functions. There is a strong belief that making such contribution 
could be accomplished by adopting recent direction of interdisciplinary research work, combining (ANN S -) with neuroscience, by 


47 


Journal of Education and e-Eearning Research , 201 7 , 4(2): 46-62 

construction of biologically inspired artificial neural models it might have become possible to shed light on behavioralfunctions 
concerned with biological neural system. 

Additionally, recent biological experimental findings have come to interesting results for evaluation of 
intelligent brain functions (Learning and memory) (Grossberg, 1988); (Freeman, 1994). However, about quarter of 
a century ago, in practical neuroscience experimental work carried out by many biologists declared results that 
even small systems of neurons are capable of forms of learning and memory (Kandel, 1979). It is well known that 
intelligence must emerge from the workings of the three-pound mass (brain) of wetware packed inside learners 1 
skulls (Kandel, 1979). analytical conceptual study for human learning creativity observed at our classrooms is 
presented (Hassan, 2008). Also, learning creativity phenomenon is an interesting and challenging issue associated 
to educational practice. Moreover, that phenomenon is tightly related to main human brain functions (Learning 
and Memory) (Freeman, 1994); (Hassan, 2007). Due to the fact of human brain’s high neuronal density, humans 
have (in approximate)! 1.5 billion cortical neurons, which more than any other mammalian brains' neurons. 
Biological information processing capacity in a brain depends on how fast its nerves conduct electrical impulses. 
The most rapidly conducting nerves are swathed in sheaths of insulation called myelin. The thicker a nerve’s 
myelin sheath, the faster the neural impulses travel along that nerve. That information travels faster in the human 
brain than it does in non-primates' brains (Ursula, 2008); (Kandel, 1979). 

Recently, the relation between number of neurons and information-processing capacity; and efficiency at 
hippocampus brain area of a mice is published at Hassan (2008). In addition, the effect of increasing number of 
neurons on learning response time (after a modified ANN model) is given at (APPENDIX B ) 

By some details about both features are tightly coupled to each other and they basically defined as follows 
(Hassan, 2007): 

1) Learning: is the ability to modify behavior in response to stored experience (inside brain synaptic 
connections). 

2) Memory: is that ability to store that modification (information) over a period of time as well as to retrieve 
spontaneously modified experienced (learned) patterns. 

Moreover, some recently published work (based on neural network modeling) illustrated the tight mutual 
relation between learning and memory (Grossberg, 1988); (Freeman, 1994); (Hassan, 2007). Additionally, about 
one decade ago two other published articles have considered learning convergence time. They presented 
respectively: modeling of neural networks for evaluation of the effect of brain learners' ability, and the effect of 
learning under noisy environmental data and not well prepared instructors (Hassan, 2016a); (Ghonaimy et al., 
1994a); (Ghonaimy et al ., 1994b). Inside brain structure, synaptic connectivity patterns relies upon information 
processing conducted through communication between neuronal axonal outputs to synapses. Obviously, 
improvement of basic building blocks(neurons) function structure inevitably conduct significant enhancement of 
global brain function. 

At Fig.l , a single biological neuron is illustrated schematically .For more details concerned with the function 
of any biological neuron , the reader is recommended to review a comprehensive foundation reference (Haykin, 
1999). Thus , enhancement of e-learners' intelligence (learning and memory) could be performed by enhancement 
of neuronal activation (response) function. Accordingly, the following subsection(2.2) presents a detailed 
mathematical formulation of a single neuron function. 
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Fig-1. A simplified schematic illustration for a biological neuronal model (adapted from, Haykin (1999)). 
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2.2. Mathematical Formulation of a Single Neuronal Function 

Referring to T.Kohenen’s two research works (Kohonen, 1993); (Kohonen, 1988) the output neuronal response 
signal observed to be developed following what so called membrane triggering time dependent equation. This 
equation is classified as a complex non-linear partial deferential. Its solution works to provide us with the physical 
description of a single cell (neuron) membrane activity. However, considering its simplified formula, which 
equation may contain about 24 process variable and 15 non-linear parameters. Following some more simplification 
of any neuron cell arguments, that differential equation describing electrical neural activity has been suggested, as 
follows: 
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E/M-ik) 


Where, 

jij represents the activity at the input (j) of neuron (i) , 
f(y t j) indicates the effect of input on membrane potential, 

j(%i) is nonlinear loss term combining leakage signals, saturation effects occurring at membrane in addition to the 
dead time till observing output activity signal. 

The steady state solution of the above simplified differential equation (l), proved to be presented as transfer 
functions. Assuming, the linearity of synaptic control effect, the output response signal is given by the equation: 


7=<t> 




( 2 ) 


W=1 J 


Where, the function (j) has two saturation limits, (/) may be linear above a threshold and zero below or linear 
within a range but flat above. 

Oi is the threshold (offset) parameter , and 

wij synaptic weight coupling between two neuron (i) and (j). 

Above function ((f)i) has been Specifically, recommended to obey odd sigmoid signal function presented by 
equation y(U) as follows: 

y (u)=(l-e- x (u-^/(i+ e -\u-*>) ( 3 ) 

Where 


i =1 

A is the gain factor value. 

® is the threshold value . 

By referring, to the weight dynamics described by the famous Hebb’s learning law (Hassan, 2007) the 
adaptation process for synaptic interconnections is given by the following modified equation: 


elects 

d = y u c, y-, y&v ( 4 ) 

Where, 

The first right term corresponds to the unmodified learning (Hebtfs law and r| is the a positive constant 
representing learning rate value. The second term represents active forgetting, a(zi) is a scalar function of the 
output response (zi). The adaptation equation of the single stage model is as follows. 

w ij =~aw tj + r/ Zl y,j ( 5 ) 

Where, the values of 77 , Zi andy y are assumed all to be non-negative quantities (Freeman, 1994). The constant 
of proportionality r/ is less than one represents learning rate value, However a is a constant factor indicates 
forgetting of learnt output (Freeman, 1994) (it is also a less than one). 

3. Brain Functions versus ANN S Modeling Performance 

Development of neural network technology is originally motivated by computer scientists, educationalists, 
psychologists, and neurobiologists' interdisciplinary strong desire. That is to investigate realistic modeling of 
ANN^ systems which implemented for contributing tasks similar to human brain functional performance. Basically 
such systems are characterized by their smartness (intelligence) and capabilities for performing intelligent tasks 
resembling experienced behaviors of human. Objectively, after a completing of training of well designed neural 
system models it is expected to respond correctly (in smart manner) and spontaneously towards input external 
stimuli. In brief, these systems well resemble human brain functionally in two ways: 

1 - Acquiring knowledge and experience through training / learning through adaptive weights neurodynamic. 

2 - Strong memorizing of acquired knowledge /stored experience within interconnectivities of neuronal synaptic 
weights. 

The adopted neural model for simulation of learning performance evaluation follows the most common type of 
ANN. It is worthy to notice that by referring to the figure given in below (Fig. 2 ), ten circles (4-3-3) represent three 
groups, or layers of biological neurons for four Inputs, three Hidden layer and one Output neuron. That is a Feed 
Forward Artificial Neural Network (FFANN) model consisted of units: a layer of "input” units is connected to a 
layer of "hidden" units, which is connected to a layer of "output" units. Obviously, any of such unit simulates a 
single biological neuron, which illustrated schematically in the above (Fig.l). Generally, the function of (FFANN) 
is briefly given as follows: 

1 - The activity of the input units represents the raw information that is fed into the network. 

2 - The activity of each hidden unit is determined by the activities of the input units and the weights on the 
connections between the input and the hidden units. 

3- The behavior of the output units depends on the activity of the hidden units and the weights between the hidden 
and output units. 
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Fig-2. A simplified schematic diagram for a (FFANN) model (adapted from, Haykin (1999)). 


Consequently, adopting of neural network modeling seems to be very relevant tool to perform simulation of 
educational activity phenomena. To implement realistically some simulated educational activities we should follow 
the advice that such models needed to be with close resemblance to biological neural systems. That resemblance 
ought to be not only from structural analysis but also from functional characterization. In other words 
understanding learning / training process carried out by ANN is highly recommended for increasing efficiency and 
effectiveness of any simulated educational activity. The statistical nature of training/learning time of convergence 
for a collection group (of ANN models) observed to be nearly Gaussian. This simulates a group of students under 
supervised learning. Additionally, the parameters of such Gaussian distribution (mean and variance) shown to be 
influenced by brain states of student groups as well as educational instrumental means. The well application of 
educational instrumentation during proceeding of learning/ training processes improves the quality of learning 
performance (learning rate factor). Such improvements are obtained in two folds. By better neurodynamic response 
of synaptic weights and by maximizing signal to noise ratio of input external learning data (input stimuli). So, any 
assigned learning output level is accomplished if and only if connectivity pattern dynamics (inside learner’s brain) 
reaches a stable convergence state, i.e. following Hebbian learning rule, connectivity vector pattern associated to 
biological neuronal network performs coincidence detection to input stimulating vector. 

4. Performance Evaluation Techniques 

The most widely used techniques for performance evaluation of complex computer systems are experimental 
measurement, analysis and statistical modeling, and simulation. Herein, all of three techniques are presented , with 
giving special attention to simulation using ANN modeling for learners' brain functions. Quantitative evaluation 
of timely updating brain function is critical for the delivery of a pre-assigned learning output level for a successful 
e-learning system. More precisely , inside a learner's brain , dynamical changes of synaptic connectivity pattern 
(weight vector) modifies adaptively convergence time, so as to deliver (output desired answer) . 

4.1. Selecting an Appropriate Learning Parameter 

Referring to some educational literature one of the evaluating parameter for learning processes is learning 
convergence time (equivalently as response time) (Haykin, 1999). By more details, at e-educational field practice 
while a learning processes proceeds, e-learners are affected naturally by technical characterizations as well as 
technological specifications of the interactive learning environment. Thus, learners have to submit their desired 
achievements (output learning levels) .Finally, by successive timely updated interaction with learning 
environmental conditions. This is well in agreement to the unsupervised (autonomous) learning paradigm 
following Hebbian rule (Hebb, 1949) in case of self-study learning. Conversely, considering the case of second 
learning way concerned with supervised learning (with a teacher) paradigm. It would be relevant to follow error 
correction learning algorithm as an ANN model (Haykin, 1999). Accordingly, two ANN models (supervised and 
unsupervised), are suggested for realistic simulation of both face to face learning ways :from tutor and from self- 
study, respectively (Al-Ajroush, 2004). 

Accordingly, learners’ updated performance is directly (globally and/or individually) influenced by 
communication engineering efficiency of interactive channels. Such channels are practically non-ideal and 
contaminated by various types of noise sources accounting to some impairment to acquired learning data (Haykin, 
1999). Of course, learning impairment accounts to worst learning performance with lower learning rate. 
Interestingly: poverty as a social phenomenon considered as environmental noise affecting learning reading 
(comprehension) performance. Moreover, the issue concerned with relation between noise effect and learning 
quality (measured by learning rate value) is discussed in details at research work (Hassan, 2016a). Obviously, 

various human/learning original phenomena such as Psychological, Cognitive styles, .etc. , should have 

significant influence on learning environmental performance. 

Conclusively, in practice; learning processes are virtually and/or actually vulnerable to non-ideal noisy data 
due to environmental conditions. Moreover, it is noticed learners' obtained achievements depends upon 
effectiveness of face to face tutoring process. Additionally, successful learners' interaction must emerge from the 
software quality of applied learning module packages. So , any assigned learning output level is accomplished if 
and only if connectivity pattern dynamics (inside learner's brain) reaches a stable convergence state. 


50 
























Journal of Education and e-Eearning Research , 201 7 , 4(2): 46-62 

Accordingly, response time needed to accomplish pre-assigned learners’ achievement is a relevant indicator 
towards quality of any under evaluation system. Obviously, after successful timely updating of dynamical state 
vector (inside e-learner's brain) pre-assigned achievement is accomplished. Consequently, assigned learning output 
level is accomplished if and only if connectivity pattern dynamics (inside learner s brain) reaches a stable 
convergence state (following Hebbian learning rule). In other words, connectivity vector pattern associated to 
biological neuronal network performs coincidence detection to input stimulating vector, i.e. inside a learner's brain, 
dynamical changes of synaptic connectivity pattern (weight vector) modifies adaptively convergence time, so as 
to deliver (output desired answer) . 

4.2. Examinations in E-Learning Systems 

In fulfillment of an e-learning system performance evaluation, time response parameter applied to measure any 
of e-learners’ achievement. Thus e-learner has to subject to some timely measuring examination that is composed 
as Multi choice questions. Hence, this adopted examination discipline is obviously dependent upon learners’ 
capability in performing selectivity of correct answer to questions they received. Consequently, to accomplish a 
pre-assigned achievement level, stored experience inside learner’s brain should be able to develop correct answer 
up to desired (assigned) level. In the context of biological sciences, selectivity function proceeds (during 
examination time period) to get on either correct or wrong answer to received questions spontaneously. 
Accordingly, the argument of selectivity function is considered virtually as the synaptic pattern vector (inside 
brain) is modified to post training status. Hence, selected answer results in synaptic weight vector has become 
capable to respond spontaneously (delivering correctly coincident answer) to its environmental input vector 
(question) (Fukaya, 1988); (Haykin, 1999). 

5. Selectivity Criteria 

Referring to adopted performance evaluation technique of e-learning systems by response time parameter. 
Accomplishment of a learner’s output is dependent on the optimum selection of correct answer as quick as possible. 
So it is well relevant to present ANN models that capable to perform selectivity function while solving some 
critical problems. Consequently, the goal of this section is that to give -in brief- an overview over mathematical 
formulations of selectivity criteria adopted by various neural network models. This overview sheds light on the 
selectivity criterion adopted by our proposed model. Presented selectivity criteria are given in a simplified manner 
for four neural network models adopting adaptive selectivity criterion, as follows: 

5.1. Selectivity Criterion by Grandmother Models (Caudill, 1989) 

On the basis of grandmother modelling, a simple sorting system has been constructed using a set of 
grandmother cells. That implies, each neuron has been trained in order to respond exactly to one particular input 
pattern. In other words, each neuron has become able (after training) to recognize its own grandmother. Appling 
such models in real world, they have been characterized by two features. Firstly, a lot number of grandmother cells 
are required to implement such grandmother model. That is due to the fact each cell is dedicated to recognize only 
one pattern. Secondly, it is needed to train that simple sorting network possible grandmother pattern to obtain 
correct output response. Consequently, all synaptic weight values at this model have to be held up unchanged 
(fixed weights). Hence, it is inevitably required to either add new grandmother cell(s),to recognise additional new 
patterns or, to modify weights of one or more existing cells to recognise that new patters. 



Fig-3. Illustrates a single grandmother cell (artificial neuronal cell) that works as processing element. (Adapted from (Caudill, 1989)) 

The above grandmother model could be described well by following mathematical formulation approach. 
The output of any grandmother cell (neuron) is a quantizing function defined as follows: 



fO when a< 0 

(6) 

Then the output y is represented by 

4>( a) = < 

[l when a> 1 

Where U is defined as 

1 

b 

ii 

(7) 
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u = Yu w i x i ( 8 ) 

i=1 

That model utilizes a set of grandmother neuronal cells (nodes). Each of these nodes responds exactly to only 
one particular input data vector pattern. Therefore, for some specific input vector pattern with m dimension is 
needed to make only one of model nodes to fire selectively to it. 


5.2. Kohonen’s Selectivity Criterion (Kohonen, 1993); (Kohonen, 2002) 

The most famous approach of neuronal modelling based on selectivity is proposed by T.Kohonen and applied 
for Self Organizing Map (SOM) (Kohonen, 1993). The SOM is based on vector input data to Kohonen neuronal 
model. That input is a vector data pattern developed as to change the status of the model. The changes are based 
on incremental stepwise correction process. The original algorithm of SOM aims to determine what so called 
winner take all (WTA) function. That function is referred to some physiological selectivity criterion applied as to 
define initially the function C that to search for mi(t) to be closest to x(t) 

C = argmm{\\x(t)-m l (t)\\} (9) 

i 

where x(t) is an n-dimensional vector data as one input sample, and mi(t) is a spatially ordered set of vector 
models arranged as a grid, and t is a running index of input samples and also index of iteration steps. The iterative 
process supposed to be continuous by time (t —» oo) as to obtain the asymptotic values of the mi constitute the 
desired ordered projection at the grid. 


5.3. Hopfield Network Selectivity Model (Haykin, 1999) 

It is proved to be closely attached with that network computational power. To obtain decisions in some 
optimisation problems, the computational power is demonstrated by the Hopfield NN model selectivity. That, it 
means the ability to select one of possible answers that model might give. Therein, resulting selectivity pattern 
(for all possible solutions) shown in a form of histogram. As numerical example, the value of selectivity of Hopfield 
neural network model was about IT 4 - 10~ 5 . That when it is applied to solve travelling salesman problem (TSP) 
considering 100 neurons. That given value of selectivity is the fraction of all possible solutions. In practice, it is 
noticeable that by increasing number of neurons comprising Hopfield network, selectivity of the network expected 
to be better (increased). The cost function concept supports the above presented selectivity criterion in TSP. By 


referring to Eq. (6) given at subsection (5.1), pattern of vector pairs are X and y the model are respectively called 
key and stored patterns of vectors . The concept of cost function is adopted as to measure of how far away we are 
from optimal solution of memorization problem. Proposed mathematically, illustrations of cost is a function of 
observations and the problem becomes that to find the model f which minimises C value 


C = E\f(x)-Y\ 


( 10 ) 


when we have only N samples of vector pairs drawn from distribution. 

C = lz| / U,)-!',f 


5.4. Selectivity Criterion for Learning by Interaction with Environment (Fukaya, 1988) 

It is worthy to note that selectivity condition considers a network model adopting artificial neurons with 
threshold (step) activation function as shown in the above at Fig.3. 

The necessary and sufficient condition for some neuron to fire selectively to a particular input data vector 
(pattern) is formulated mathematically as given in below. 

Consider the particular input pattern vector 



Hence, 



&<u c 


( 12 ) 


for any m satisfying 


for any m satisfying 


© > £7 +W 


0 = 

0> 


U c -w m 


1 = 


x 


cm 


u =Yw.x 

c / J i Cl 

i =1 

...;. ( 13 ) 

Where 0 is the fixed threshold value controlling firing of the neuron. 
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6. Modeling E-Learning Performance 



Fig-4. A general view for interactive educational process presenting face to face Interaction 


6.1. Modeling of Face to Face Tutoring (Al-Ajroush, 2004) 

In face to face tutoring , the phase of interactive cooperative learning is an essential paradigm aiming to 
improve any of e-Learning Systems’ performance. In more details, face to face tutoring proceeds with three phases 
(Learning from tutor, Learning from self-study, and Learning from interaction with fellow learners), it has been 
declared that cooperative interactive learning among e-learning followers (studying agents learners).That 
phase contributes about one fourth of e-learning academic achievement (output) attained during face to face 
tutoring sessions (Al-Ajroush, 2004). At next subsection two phases concerned with the first and second phases are 
molded by one block diagram. However two diversified mathematical equations are describing the two phases 
separately. At the next subsection cooperative learning is briefly presented by referring to Ant Colony System 
(ACS) Optimization. 



Fig-5. Block diagram for learning paradigm adopted for quantifying creativity adapted from Haykin (1999). 

The error vector at any time instant (n) observed during learning processes is given by: 
e(n) - y{n)~ d(n ) (14 

Where 

e(n ) : Error correcting signal controlling adaptively 
y{n) : The output signal of the model 

d(n) : Numeric value(s) of the desired /objective parameter of learning process (generally as a vector).Referring to 
above Figure 5; following equations are considered: 


V k (n)=Xj(n)WT kj (n) (15) 

y k (n)=cp(V k (n))= 1 /(1 +e-\( n )) (16) 

e k (n)= | d k (n)-y k (n) | (17) 

W k j(n+ l)=W k j(n)+AW k j(n) (18) 


Where: X input vector, W weight vector, cp is the activation function, y is the output, ek the error value, and dk 
is the desired output. Noting that AWkj(n) the dynamical change of weight vector value. 

The above four equations are commonly applied for both learning phases, supervised (Learning from tutor), 
and unsupervised (Learning from self-study). The dynamical change of weight vector value specifically for 
supervised phase is given by equation: 

AW kj (n)=r| e k (n) Xj(n) (19) 

Where r| is the learning rate value during learning process for both learning phases. However, for unsupervised 
paradigm, dynamical change of weight vector value is given by equation: 

AWkj(n)= r i y k (n) Xj (n) (20) 
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6.2. Gain Factor versus Learning Convergence 

Referring to Hassan (2016a); Hassan (2014) learning by coincidence detection is considered. Therein, angle 
between training weight vector and an input vector have to be detected. Referring to Freeman (1994) the results of 
output learning processes considering Hebbian rule are following the equation: 

y = ( (21) 

The above equation performs analogously to gain factor (slope) in classical sigmoid function (Grossberg, 1988). 

y(t) = : 1 o, ( 22 ) 


l + e~ M 

However, equation (8) performs versus time closely similar to odd sigmoid function given as 

-At 


y(t) = 


l 


l + e 


-At 


(23) 


For 


0 < t < oo 



Fig-6. Illustrates three different learning performance curves Y1&Y2 and Y3 that converge at time tl&t2 ,and t3 considering different 
gain factor values 1 & 2 ,and 3. adapted from Freeman (1994). 


Referring to Fig.6; the three curves shown represent different individual levels of learning. Curve (Y 2 ) is the 
equalized representation of both forgetting and learning factors (Freeman, 1994). However curve (Yi) shown the 
low level of learning rate (learning disability) that indicates the state of angle between synaptic weight vector and 
an input vector . Conversely, the curve (Y 3 ) indicates better learning performance that exceeds the normal level of 
learning at curve (Y 2 ). Consequently learning time convergence decreases as shown at Fig.6, (ti& t 2 , and t 3 ) 
three different levels of learning performance curves representing: normal, low, and better cases shown at curves 
Yi&Y 2 and Y 3 respectively. 


7. Simulation Results 

7.1. Gain Factor Values versus Response Time 

The graphical simulation results illustrated in the below Figure 7, gain factor effect on improving the value of 
time response measured after learning process convergence, Hassan (2004). These four graphs at Fig.7 are 
concerned with the improvement of the learning parameter response time (number of training cycles). That 
improvement observed by increasing of gain factor values (0.5, 1, 10,and 20) that corresponds to decreasing 
respectively number of training cycles by values (I0,7.7,5,and3) cycles, (on approximate averages). 



Fig-7. Illustrates improvement of average response time (no. of training cycles) by increase of the gain factor values. 
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7.2. Effect of Neurons' Number on Time Response 

The following simulation results show how the number of neurons may affect the time response performance. Those 
graphical presented results show that by variation of neural cells’ numbers (14 ,11 ,7 ,5 ,and 3 ); during interaction of students 
with e-learning environment, the performance observed to be improved well by increasing of neuronal cells’ number 
(neurons).That improvement is observed by Figures: (8,9, 10, 11, 12) respectively; considering fixed learning rate = 0.1 and 
gain factor = 0.5. 

In more details, these five figures have been depicted from the reference source : Hassan, M. H."On performance evaluation of 
brain based learning processes using neural networks," published at 2012 IEEE Symposium on Computers and Communications 
(ISCC), pp. 000672-000679, 2012 IEEE Symposium on Computers and Communications (ISCC), 2012. Available online at : 
http://www.computer.org/csdFproceedings/iscc/2012/2712/00/IS264-abs.html 


No. of occurrences for each Time 



Figure-8. Considering # neurons= 14 


No. of occurrences for each Time 



Time (No. of training cycles) 
Figure-9. Considering # neurons= 11 

No. of occurrences for each Time 
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Time (No. of training cycles) 
Figure-10. Considering # neurons= 7 


No. of occurrences for each Time 



Time (No. of training cycles) 
Figure-11. Considering # neurons= 5 
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No. of occurrences for each Time 



Figure-12. Considering # neurons= 3 


7.3. Analogy of Behavioral Learning versus Cooperative Learning By ACS 

Cooperative learning by Ant Colony System for solving TSP referring to Figure 13 which adapted from 
Dorigo and Gambardella (1997) the difference between communication levels among agents (ants) develops 
different outputs average speed to optimum solution. The changes of communication level are analogues to 
different values of X in odd sigmoid function as shown at equation (24) in below.. When the number of training 
cycles increases virtually to an infinite value, the number of salivation drops obviously reach a saturation value 
additionally the pairing stimulus develops the learning process turned in accordance with Hebbian learning rule 
(Hebb, 1949). However in case of different values of X other than zero implicitly means that output signal is 
developed by neuron motors. Furthermore, by increasing of number of neurons which analogous to number of ant 
agents results in better learning performance for reaching accurate solution as graphically illustrated for fixed X at 
Figure 14 (Rechardson, 2006); (Bonabeau, 2001). 



Number of Agents 


Figure-13. Illustrates performance of ACS with and without communication between ants. 

The source is Dorigo and Gambardella (1997). 

This different response speed to reach solution is analogous to different communication levels among agents 
(artificial ants) as shown at the Fig. 10. It is worthy to note that communication among agents of artificial ants 
model develops different speed values to obtain an optimum solution of TSP, considering variable number of 
agents (ants). 
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Fig-14. Communication determines a synergistic effect with different communication levels among agents leads to different 
values of average speed. 


Virtual 

i:\UtiMun 


234 5 6789 

Number of Agents 


. 0.2 
Average 

speed to 0.15 

optimal 

solution 0-1 

(1;SeC > 0.05 


Consequently as this set of curves reaches different normalized optimum speed to get TSP solution (either 
virtually or actually) the solution is obtained by different number of ants, so this set could be mathematically 
formulated by following formula: 


f 

fin ) = a 

v 


l-e~f 

1 + <?-*", 


(25) 


Where a . is an amplification factors representing asymptotic value for maximum average speed to get 

optimized solutions and X in the gain factor changing in accordance with communication between ants. 

Referring to the figure -- in below, the relation between number of neurons and the obtained achievement is given 
considering three different gain factor values (0.5 , 1 ,and 2) 



Fig-15. Illustrate students' learning achievement for different gain factors and intrinsically various number of neurons which measured for 
constant learning rate value = 0.3. 


However by this mathematical formulation of that model normalized behavior it is shown that by changing of 
communication levels (represented by X) that causes changing of the speeds for reaching optimum solutions. In 
given Fig. 16. in blow, it is illustrated that normalized model behavior according to following equation. 
y(n)= (l-exp(-A,i(n-l)))/ (l+exp(-A,i(n-l))) (24) 

where Xi represents one of gain factors (slopes) for sigmoid function. 

Normalized Output fy(n)] 
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Number of Training Cycles(n) 

Fig-16. Graphical representation of learning performance of model with different gain factor values (X) 


8. Conclusions & Future Work 

Herein, some conclusive remarks related to the obtained results are presented as well as some expected 
relevant future research directions that is carried out considering the effect of internal (intrinsic) learners' brain 
state as well as external environmental factors upon convergence of learning / training processes. 

8.1. Conclusions 

Through above presented performance evaluation approach, three interesting points are concluded 
subsequently to enhance quality of e-learning systems as follows: 

1- Evaluation of any e-learning system's quality following previously suggested measurement of learning 
convergence/response time. The experimental measured average of response time values (quantified evaluation), 
provides educationalists with a fair and unbiased judgment for any e-learning system (considering a pre-assigned 
achievement level). 

2- As consequence of above remark, relative quality comparison between two e-learning systems (on the bases of 
suggested metric measuring) is contributed by quantified performance evaluation. 

3- modification of learning systems performance obtained by increment of learning rate value, which is expressed 
by the ratio between achievement level (testing mark) and the response learning time. This implies that learning 
rate could be considered as a modifying parameter contributes to both learning parameters (learning achievement 
level and learning convergence time response). 

8.2. Future Research Work 

The following are some research work directions that may be adopted in the future : 

1- Application of improved synaptic connectivity with random weight values in order to perform medically 
promising treatment of mentally disable learners. 

2- Simulation and modeling of complex educational issues such as deterioration of achievement levels at 
different learning systems due to non well prepared tutor . 

3- Study of ordering of teaching curriculum simulated as input data vector to neural systems. That improved 
both of learning and memory for the introduced simulated ANN model. 

4- Experimental measurement of learning systems' performance in addition to analytical modeling and 
simulation of these systems aiming to improve their quality. 

Finally, more elaborate evaluation and assessment of individual differences phenomena that is needed critically 
for educational process. 
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APPENDIX- A 

The following program listing illustrate the mathematical modeling equations given in the above considering 
learning (with supervision paradigms). It is originated from Error Correction Learning Algorithm. 

Supervision Learning Model 

w=rand(3,100); 

xl=0.8;x2=0.7;x3=0.9;l=0.5;eata=0.1; 
for i= 1:100 

w 1 =w(l,i);w2=w(2,i);w3=w(3,i); 
net=w 1 *x 1 +w2*x2+w3*x3; 
y=( l-exp(-l*net))/(1 +exp(-l*net)); 


60 



Journal of Education and e-Eearning Research , 201 7 , 4(2): 46-62 


e=0.8-y; 
no(i)=0; 
while e>0.05 
no(i)=no(i)+l; 
w 1 =w 1 +eata*e*x 1; 
w2=w2+eata*e*x2; 
w3=w3+eata*e*x3; 
net=wl*xl+w2*x2+w3*x3; 
y=( 1 -exp(-l*net))/(1 +exp(-l*net)); 
e=0.8-y; 
end 
end 

for i= 1:100 
n°g(i)=0; 
for x= 1:100 
if no(x)==i 
nog(i)=nog(i)+l; 
end 
end 
end 

i=0:99; 

plot(i,nog(i+1 ),'linewidth', 1.5) 
xlabel('no of training cycles') 
ylabel('no of occurrences for each cycle') 
title('error correction algorithm') 
grid on 
% hold on 

APPENDIX -B 

The following program listing illustrate the mathematical modeling equations given in the above section 
considering learning (without supervision paradigm). 

Hebbian Learning Rule Algorithm 
w=rand( 1000,1000); 
xl=0.8; x2=0.7;x3=0.6; 1=10; eta=0.3; 
for g= 1:100 
nog(g)=0; 
end 

for i= 1:1000 

wl=w(l,i); w2=w(2,i);w3=w(3,i); 
for v= 1:2 %constant no of itr. 

% no(i)=no(i)+l; 
net=wl*xl+w2*x2+w3*x3; 
y= 1 /(1 +exp(-l*net)); 

%e=0.9-y; 
w 1 =w 1 +eta*y*x 1; 
w2=w2+eta*y*x2; 
w3=w3+eta*y*x3; 
end 

p=uint8((y/0.9)*90); 
nog(p)=nog(p)+l; 
end 

i=0:89; 

plot((i+1)/100,nog(i+1 ),'linewidth', 1.5,'color','black') 

xlabel('nearness of balance point') 

ylabel('No of occurrences for each cycle') 

title('Hebian algorithm') 

grid on 

hold on 

APPENDIX -C 

A simplified macro level flowchart describing algorithmic steps (for various numbers of neurons) using 
Artificial Neural Networks modeling. 
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